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ABSTRACT 



Purpose; This Investigation was conducted to determine: (I) the extent 
of dissemination of the Research Utilizing Problem Solving (RUPS) and 
Development of Higher Level Thinking Abilities (TABA) Instructional 
systems developed by the Northwest Aaglonal Laboratory (NWREL), (2) the 
degree of conformity between the RUPS and TABA systems as developed and 
that usod In the field, and (3) the perceptions and extent of usage. 
Data were gathered through a mall survey to both trainers and trainees 
who participated In the programs. 

FIndlnos; TABA respondees perceived themselves generally as utilizing 
their training with a high degree of regularity. Significant differ- 
ences were found among the usage of training by experienced teachers. 
I.e., TABA training seemed to be more valuable to them than to less 
experienced or inexperienced teachers. 

Analysis of the WJPS Instructional system showed few differences 
between respondent sub-groups. It appeared that TABA was used more 
frequently in classrooms than RUPS training. 

Conclusions; TABA training shouio be primarily aimed at In-service with 
experienced teachers. RUPS training may not be as useful to classroom 
teachers as Is TABA. 
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Chapter I 
INTRODUCTION 



Statement of the Problem 

Instructional systems are being used extensively across the 
nation, especially for In-servlce training of teachers. These systems 
are usually recognized as being an economic means of Increasing teacher 
competencies. However, the decision to adopt any system can Involve a 
consldenble expenditure of resources, and therefore adopting agencies 
should be aware of any program evaluation that Is available. 

Since the Fall of 1966, the Northwest Regional Educational 
Laboratory (NWREL) has been developing and disseminating many Instruc- 
tional systems under its "Program 100." All of these systems have been 
extensively field tested with workshop evaluations being a standard com- 
ponent of each system (See for example, "Final Report of the Evaluation 
of the Reseirch Utilizing Problem Solving Process Workshops," In E.P.D.A. 
Project spcisored by the Idaho Consortium, January, 1970). NWREL has 
also conducted cognitive and behavioral follow-up studies for all systems, 
sa-ne of which are summarized below. 

The present study was designed to evaluate selected aspects of 
the two most widely-used NWREL systems: Laboratory Program 122, 
Development of Higher Level Thinking Abilities" (TABA), and Laboratory 
Program 1^2, "Research Utilizing Problem Solving" (RUPS). These two 
systems have been utilized by colleges and universities, by state educa- 
tional agencies, and by school districts; especially In the Pacific 
North-^est. , 



Th3 pr^«=!erl^ study attempts to evaluate whether perscis who have 
been trained under one of these systems perceive themselves as using the 
skills end concepts purported to be Instilled by these systems, and will 
therefore sss'st potential adopters In their declslois about these 
systems. The findings of this study will not be generallzable to other 
Instruct I o:.n I systens, but the techniques may. Objectives of the 
Investigation were to: 

1. Determine the extent of use of the systems within the area 
served by the Northwest Regional Education Laboratory: 
Alaska, Idaho, Montana, Oregon, and Washington. 

2. Establish whetne.- or not the teacher training program 
:;ctually being taugnt by TABA and RUPS .trainers and the 
Instructional systems being produced by the Laboratory 
were essentially the same. 



3. Analyze data gathered by the Instruments devised, drawing 
generalizations and conclusions concerning the value of the 
systems for teacher training. 

4. Develop Instruments to assess the extent of use of TABA and 
RUPS by persons who were trained under these systems. 



Description of "Devel opment of Higher Level Thinking Abilities" (TABA ) 

The research base for this Instructional system was the work of 
the late Hilda Taba as outlined in two of her publications. Curriculum 
Development; Theory and Practice. (Taba, 1962) and Cognitive Functioning 
In Elementary School nhiMren, (Taba, 1966). Under the sponsorship and 
directorship of the NWREL, the "Development of Hloher Level Thinking 
Abilities" system was developed by relating Taba's research to Benjamin 
Bloom s Taxonomy of Education al Objectives. Handbook I ; Cognitive Domain . 
(Bloom, 1956) and to Norris M. Sanders' Classroom Questions. What Kinds?. 
(Sanders, 1966). 

The system was designed to lead participants through a series of 
learning experiences for each of three essential thinking processes: 
Concept Diagnosis, interpretation of Data, and Application of Knowledge. 
These learning experiences are: 

1. Sensitivity experiences 

Participants are introduced to each essential process by 
simulation with participants role-playing as students and 
the trainer role-playing as teacher. 

2. Knowledge base 

_ This activity Is a didactic presentation of the theoretical 
base for the thinking activity. 

3. Simulation experiences 

Participants use the behavior that characterizes the process 
in studying the process Itselr. A problem is presented 
which the participants discuss and this is where the 
learning should take place. 

4. Learning experiences 

Participants use the process in the classroom with systematic 
data CO, lection and feedback from subsequent discussion. 

5. Application 

Participants use the processes in developing lessons in a 
chosen curriculum area (McCollum and Davis, 1968). 
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Desc-lptlon or "Research UtlUzIng Problem Solving" (RUPS) 



The RUPS system was developed to prepare teachers to solve 
organizational problems In the classroom and to use Innovative strategies 
for Instruction, The specific objectives of the RUPS program Include: 
(t) formulating Improvement goals; (2) using data-gathering Instruments 
and techniques for diagnosing classroom conditions; (3) deriving action 
Implications from research and data gathered In the local schools; 
(4) designing action research projects at the classroom and building 
level; (5) using Instruments for evaluative assessment; (6) analyzing and 
Interpreting action research data; (7) disseminating results and Innova-- 
tlons. (For a list of activities see Appendix 

The RUPS system was developed at the University of Michigan by 
the Cooperative Project for Educational Development, The system relies 
upon the action-research theories of Charles Jung and the force field 
analysis theories of Kurt Levin (NWREL, 1970), 

The NWREL considers the content of both programs RUPS and TABA 
to be completed, although the RUPS system Is being adapted for use with 
different groups, such as administrators and change agents as of the time 
of this study. 



Summary of NWREL Research on RUPS and TABA 

Data collected by NWREL evaluators on the RUPS system show that 
In 23 workshops (n=1147) 3.1 out of every four participants (7 75?) ra-ted 
their workshop experiences as very worthwhile (using both rating scales 
and open-ended value statements). Data from an additional four workshops 
(n«81) reported that 8]% of the participants stated a "strong Intention" 
to use their learning In their work. The NWREL assumed that these 
findings are attltudlnal presuppositions for continued dissemination and 
Implementation. 

The NWREL has also collected data on skills acquisition. In 
their summary of findings In this area, their writers stated that: 

With respect to the essential learning content of the RUPS 
training program. Problem Solving and Team Building Skills, 
data from nine workshops (n=233) shows that 68% of all 
participants specified one or more Problem Solving Skills 
or Impoi-tant learning benefits, and 825? so specified one 
or more Team Building Skills. (These figures Include those 
who specified benefits In both skill areas.) Less than 15? 
of the participants made negative comment pertaining to 
either skills area. The endorsement of these skills by 
three out of every four participants gives substantive 
meaning to the high valuation of RUPS training by workshop 
participants (NWREL, 1972). 
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Learning gains gathered from four workshops (n=145) show that 
three out of four participants performed at or above the 15% correct 
Pn!!!'"i?",iT ; !" r° ^^"^ workshop m of the participants applied 
the 75% criterion level of correct performance (NWREL, 1972). 

In a publication released In February of 1971, the NWREL 
evaluators summarized TABA research as follows: 

1. Participants react favorably to the TABA training program. 
Seventy-five percent of the participants were totally 
positive in thefr attitude toward training from the 
beginning of data collection to the last series of tests 

C n"290 ) • 

2. Participants learn conceptual content of training. Mean 
post training score exceeds 80^ correct criterion level 
(n=37). 

3. Flanders analysis, specific TABA coding and student 
descriptions of teacher behavior for different samples 
all indicate increased student initiative and enthusiasm. 
Increased teacher-pupil openness, improved teacher ques- 
tioning styles and Increased teacher use of student Ideas 
after training (n=79. Control n=43). 

4. Follow-up data (some collected as long as four years after 
training) shows that 11% of tho trainees still value the 
questioning strategies, frequently use them in the class- 
room, and In general, retain knowledge of the system after 
training (n=67) (NWREL, 1971). 

. II!®^! figures are compared with data from the present investiga- 
tion In Chapter III. ^ 



Theoretical Basis and Objectives 

The theoretical basis used for this study was that of an 
a-exper I mental investigation" as described by Egon C. Guba (1965). 
Cuba has long advocated a shift away from traditional .experimental 
design in studying program dissemination. He outlined the differences 
between the experimental and the a-exper imenta I as being primarily 
differences of Intent. The experimental Investigator Inquires into 
what might happen—into possibilities associated with Intervening 
variables while investigators using a-exper Imenta I design should 
Inquire Into what has- happened— Into actualities. The advantage of the 
a-exper imenta I method is that it is context-free, i.e., variables and 
data can be explored whenever and wherever they occur. The number of 
variables In an a-exper imenta I study are unlimited, whereas in an experi- 
mental study they must be strictly controlled. It Is obvious that in an 
on-going educational program, such control Is Impossible. 
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John K. Hemphill (1969) agrees that intent is the critical 
factor which distinguishes evaluation studies from traditional educa- 
tional research. He presents a rationale that an evaluation study must 
be viewed "within a context of decision-making, rather than within a 
framework provided by purposes and conventions of research" (HemDhlll 
p- 190). ' 

Below Is a summary of \ characteristics of evaluation 

studies. It can be observed thar ,ney form a dichotomous branch when 
compared to those defined for research. 



Research 

1. Problem selection and defini- 
tion Is the responsibility of the 
individual doing the research. 



2. Tentative answers (hypotheses) 
to the problem may be derived by 
deduction from theories or by In- 
duction from an organized body of 
knowledge. 



3. Value judgments by the re- 
searcher are limited to those 
Implicit In the selection of the 
problem. 

4. Given the statement of the 
problem and the hypothesis, the 
research can be replicated. 

5. The data to be col lected are 
determined largely by the problem 
and the hypotheses. 

6. Relevant variables can be 
controlled or manipulated, and 
systematic effects or other 
variables can be eliminated by 
randomization. 



Evaluation 

1. The problem is determined by 
the situation In which the study 

Is conducted. The problem, because 
of Its complexity, may Involve 
many definers. 

2. The task Is one of testing 
generalizations rather than testing 
hypotheses. There are many gaps 
which in the absence of verified 
knowledge must be filled by reliance 
on judgment and experience. 

3. Value judgments must be made at 
all stages of the study. 



4. The study Is unique to a 
situation and can seldom be repli- 
cated, even approximately. 

5. All data collection Is deter- 
mined by feasibility and all 
choices are value judgments. 

6. Only superficial control of a 
multitude of variables Is possible. 
Randomization is extremely difficult 
or Impractical to accomplish. 
(Hemphill, p. 190-191). 



Evaluation studies, according to Hemphill, can contribute to the 
development of educational knowledge, just as empirical research can. 
He stated that "Both profit from and stimulate the development of theory. 
Beth can contribute to a science of education and perhaps both are re- 
oJred for its orderly development" (Hemphill, p. 191). 



stake and Denny further stated that educational evaluation must 
Include". . . the task of gathering Information about the nature and 
worth of educational programs In order to Improve decisions about the 
management of those programs." (Stake and Denny, p. 373). 



Description of Activities 

The first step of the Investigation was to conduct a survey to 
obtain and determine: (1) the names and addresses of all trainers utili- 
zing these two Instructional systems either as pre>servlce or In-service 
teacher training within the target area; and (2) the names and addresses 
of all persons who have been trained, on an In-servica basis, by the 
trainers. The t>IWREL was the principal source of Information for It«ns 
(1) and (2) above. Education Departments and Extension offices of the 
target area's colleges and universities were other sources. Preliminary 
data from a NWREL report Indicated that there were 1350 trainees under 
TABA and 1222 trainees under RUPS (NWREL, 1970,b). This first activity 
was to gather, sort, and tabulate the Information obtained from those 
active trainers end those teachers trained In TABA and RUPS between 
June 1969, and August 1970. 

Two Instruments were designed for the second objective (conver- 
gent programs), one for TABA trainers and one for RUPS trainers. These 
Instruments elicited responses on specific components of each program, 
so that variations, omissions, and any other changes could be ". . . 
clearly described and that outcomes be related to the training as given 
rather than to our product when It Is not our product which Is being 
utilized'* (See appended letter from Dr. Jean Butman, Research and Evalu- 
ation Ck)ordlnator for the Laboratory). All trainers and their Institu- 
tions were assigned codes so that data collected under Activity 3 
(described below) could be tabulated and analyzed according to such 
variations, emissions and changes. 

Two questionnaires were designed to elicit needed data for the 
third objective (value of the systems), one for RUPS trainees and one 
for TABA trainees. Data were also gathered to enable the evaluator 
to determine patterns of utilization. 

With these data, the investigator (1) summarized the extent of 
utilization of the RUPS and TABA systems, (2) reported conforrolly of the 
programs being taught to the system disseminated by the Laboratory, and 
(3) tabulated and analyzed use patterns of these systems as perceived by 
the trainees. Data were compared to determine 'f there were significant 
differences among the following sub-groups: 

1. District size (rural /urban). 

2. Teaching level (elementary /secondary). 

3. Years of experience of Trainers and Trainees. 

4. Those trainers who were actively teaching at the time of 
their training and those who were not. 



Chi square tests were used with the .05 level of significance 
being selected as acceptable to the Investigator. 

The Investigator also analyzed and compared the percentage 
ratings of the above sub-groups for other selected data. 



Relevance of the Study 

The findings will be useful In determining to what extent the 
two systems were used in the area's schools, and should assist higher 
Institutions and school districts in making decisions about utilizing 
the systems In In-service and pre-servico leacher training. 

The use of instructional systems developed by research and field 
iusting Is growing throughout the nat5on as a device for In-service 
teacher training. Therefore data on these two systems will be of broad 
concern. The result of the use of TABA and RUPS as classroom strategies 
by trainees may be decisive In designing additional In-service programs. 



Methodology 

All data for this study were gathered through the use of mailed 
questionnaires. Trainer questionnaires and cover letters were developed 
and mailed to all persons who, according to the NWREL, were qualified to 
conduct workshops In RUPS and/or TABA. This survey was necessary to 
determine whether trainers In the field perceive themselves as using the 
complete systems as developed by the NWREL, or if they made substantial 
changes. These questionnaires itemized components of both systems and 
asked respondents to check In appropriate columns If they omitted or 
changed any component. The results of this part of the survey are 
reported In Chapter II. 

Only trainers who had conducted workshops during the target 
dates of June 1, 1969 to August 30, 1970 were mailed questionnaires. 

Two questionnaires were developed for trainees under the two 
systems. The same target dates were used. All trainees whose responses 
were utilized In this study were trained by those persons who are con- 
sidered qualified trainers by the NWREL, but not all of the trainers 
returned questionnaires. This aspect of the study will also be reported 
^n Chapter II. 

The names and addresses of trainees were obtained from the NWREL 
and from colleges and universities within the area served by the NWREL, 
Washington, Oregon, Idaho, Montana, and Alaska. Three hundred seventy- 
nine (379) usable RUPS questionnaires and three hundred sixty-two (362) 
TABA questionnaires (545^ and 50? respectively) were thus available for 
tabulation and c-^alysls. David J. Fox, In his book The Research Process 
In Education, stated that when a research population can be considered 
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to be a homogenous mass, "... one third or one fourth c that mass can 
be considered to be providing some Insight Into the views of that mass" 
(Fox, 1969). 

The format of all questionnaires was approved by the Director of 
the Data Processing Center at Eastern Washington State College. The 
content of the questionnaires was examined and approved by two persons 
who were qualified trainers under the two systems. All of the items on 
the questionnaires were developed to correlate as closely as possible 
with Instruments used by the NWREL, although no attitudlnal Instrument 
was available from the NWREL for RUPS. 

After all of the questionnaires were collected, a computer program 
for data treatment was completed and reports were printed Including total 
numbers and percentages. Because this study was designed to evaluate 
the responses of teachers, the data accumulated for other personnel such 
as acinlnlstrators are reported only as percentages, and a comparison was 
made for Items of a demographic concern. 

All comments were examined for patterns, and those that seemed 
useful to the Investigator are listed by category In Appendix F. 
Several generalizations based upon the comments are Included In 
Chapter 1 1 . 



Chapter I | 

THE TABA STUDY: SUMMARY AND CONCLUSIONS 



General Findings 

The trainer survey revealed that all TABA trainers who responded 
perceived themselves as implementing the TABA system substantially as it 
is presented in the NWREL manual; therefore all trainee responses were 
treated uniformly, if a trf.lner had perceived of himself as omitting or 
substantially changing any components of the TABA instructional system, 
the responses from trainees who had received such revised training would 
have been treated separately from those who received the complete program. 

Since the primary purpose of this investigation was to determine 
the perceptions of classroom teachers as to their usage of their training 
the general findings of this part of the study are discussed first. The ' 
three questionnaire items on usage were: 

VIII. Please respond to each of the following statements as you 
perceive yourself using the processes and ideas learned 
during your TABA training. 

A. To what extent have you used the processes and ideas 
in "Concept Diagnosis" in your classroom since you 
received your TABA training? 
1- Never Comments 

2. Once since the training 

3. A few times 

4. Once a month 

5. Once a weel<^ 

6. One or more times daily 



B. To what extent have you used the processes and ideas 
in "Interpretation of Data" in your classroom since 
you received your TABA training? 
!• Never Consents 

2. Once since the training 

3. A few times 

4. Once a month^ 

5. Once a vieek 

6. One or more times dai ly 
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To what extent have you used the processes and ideas 

In "Application of Knowledge" in your classroom since 
you received your TABA training? 
1- Never Comments 



2. 
3. 
4. 
5. 
6. 



Once since the train ing_ 

A few times [ 

Once a month 

Once a week 



One or more times dai ly 



The responses and percentages for the three usage items are shown 
in Table 1 below. 



TABLE I - Reported Usage by Respondents 





Number 


Percent 


Questionnaire Items 


Respond Inq 


ResDondina 


VI ll-A. Concept Diagnosis 






1 . Never 


9 


3.3 


2. Once since training 


4 


1.5 


3. A few times 


108 


39.3 


4. 1 /month 


47 


17.1 


5. 1/week 


63 


22.9 


6. 1/day 


44 


16.0 


Totals 


275 


96.5* 


VII l-B. Interpretation of Data 






1 . Never 


11 


4.1 


2. Once since training 


3 


1.1 


3. A few times 


105 


38.9 


4. 1 /month 


40 


14.8 


5. 1/week 


65 


24.1 


6. 1/day 


46 


17.0 


Totals 


270 


94.7 



Vlll-C Application of Knowledge 

1 . Never 

2. Once since training 

3. A few times 

4. 1 /month 

5. 1/week 

6. 1/day 

Tota ; s 



12 

5 

102 
34 
69 
44 

266 



4.5 
1.9 
38.3 
12.8 
25.9 
16.5 

93.3 



Since all respondents did not mark each Item, all computations 
were based upon only marked Items. Percentage totals on all tcbles In 
this study show total respondents that marked that particular Item. 
Hence Item VI ll-A In Table 1 means that 96.5% of all teacher respondents 
marked this Item. 
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TABLE 2 - Average of Usage Item Responses 



Response 
Category 


Average 
Number of 
Responses 


Average 
Percentage 
of Responses 


Interpretation 


1 . Never 


11 


3.7 


TABA 

Strategies rejected 


2. Once 
since 
train! nc 


4 


1.5 


TABA 

Strateales tried 
but rejected 


3. A few 
times 


105 


38.8 


TABA 

Strategies partial ly 
adopted 


4. 1 /month 


40 


14.9 


TABA 

Strategies partially 
adopted 


5. 1/week 


66 


24.3 


TABA 

Strategies adopted 


6. 1/day 
or more 


44 

' 


16.5 


TABA 

Strategies adopted 
and Integrated 



Th e percentage figures shown In Tab l es 1 and 2 abov e are the most 
Importanrs^att stics f rom the TABA surv ey. '\ h^y show +h;.+ ,»rn^ p^r- 
centage of respondents (55.7) marked one of the last three categories, 
which the Investigator Interpreted as meaning regular classroom usage. 
These respondents perceived themselves as using their training In the 
classroom with varying but high degrees of regularity. Also, those who 
checked that they used each activity once a week, actually perceived 
themselves as using some part of TABA three times a week. 

^k'^? additional 38.8^ of the respondents perceived themselves as 
using their training "a few times." The investigator Interpreted this 
category as meaning that the TABA training had a small effect on their 
classroom techniques. 

The small percentage (5.2) who responded in the "never" or 
mSJf+K'r^K^'".!;!"^" =^+«9ories are interpreted by the Investigator to 
mean that the TABA strategy was rejected by those respondents. That 
these figures are very low is a strong indicator that the TABA system 
has a lasting Impact on nearly all trainees. 
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The NWREL statistics which are previously cited In Chapter I 
state that 11% of the respondents to the NWREL instrument frequently use 
the questioning strategies in the classroomJ The figures from the 
present study indicate regular classroom usage by 55. 7? and some class- 
room usage by 38.8^.2 The NWREL also found that 11% of the trainees 
retained knowledge of the system after their training. While the present 
study did not gather such cognitive data, the investigator assumes that 
all respondents but two understood the strategies well enough to at 
least evaluate their own degree of usage. The present study therefore 
Indirectly verifies the NWREL's claim that most trainees do retain their 
knowledge of the TABA system. 

Other tabulations of data showed that with a few exceptions, 
respondents were consistent in perception of their usage: that is. If 
the respondent perceived himself as using "Concept Diagnosis" once or 
more times per day, he also perceived himself as using "Interpretation of 
Data" and "Application of Knov/ledge" once or more times per day. 



Chl-Square Analysis 

The data tabulation Is Included to show how the respondents 
reacted to the questionnaire Items. Several data sorts were made, and 
within each specific sort, questions were analyzed to observe if the 
sorted groups responded similarly or not to the particular ques+lon. The 
statistical device used was a two-way contingency table, the pertinent 
statistic being the chi-square statistic. If the statistic computed Is 
smaller than the tabular value, the h/pothesis can be accepted that the 
groups being tested are compatible. If the statistic Is greater than 
the tabular value, the groups are deemed Incompatible. The level of 
significance used throughout is .05, a conventional choice. All data 
sorts were made on a COC 3200 computer. 

After the sorts were made, each of the six data groups from 
Table 2 were set up on contingency tables with each of the three usage 
Items and also with each other to determine if usage patterns emerged. 
Each of the following tables, 4 through 13, states the chl-square, the 
degrees of freedom and if these figures showed that the differences were 
critical under the .05 level of significance. 

For convenience, the chl square distribution for .05 Is dupli- 
cated In Table 3.3 ^ 



Vhe NWREL considers the last three categories, 1/month or more, 
as regular classroom usage. 

^hese figures from the NWREL were gathered from a selected sample 
of trainees who received their training in the early stages of TABA devel- 
opment. The time lapse was from one to four years of training. The time 
lapse of the present study was from one to tvo years. 

'as shown In "Statistical Methods for Research Workers " by 
R.A. Fisher, 6th Edition, 1969. (Edinburgh: Oliver and Boyd).' 
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TABLE 3 - Chi Square Distribution 



Degrees 

of 
Freedom 



0.05 



1 


3.841 


2 


5.991 


3 


7.815 


4 


9.488 


5 


1 1 .070 


6 


12.592 


7 


14.067 


8 


15.507 


9 


16.919 


10 


18.307 


11 


1 

1 19.675 


12 


t 21.026 


13 


22.362 


14 


23.685 


15 


24.996 


16 


26.296 


17 


27.587 


18 


28.869 


19 


30.114 


20 


31.410 


21 


32.671 


22 


33.924 


23 


35.172 


24 


36.415 


25 


37.652 


26 


38.885 


27 


40.113 


28 


41.337 


29 


42.557 


30 


43.773 
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TABLE 4 - Teaching Level Analysis of Questlonndlre Item M 





Chi Square 


Degrees of 
Freedom 


Significant 


VI 


l-A. 


Concept Diagnosis 


29.701 


20 


no 


VI 


I-B. 


Interpretation of Data 


18.801 


20 


no 


VI 1 


I-C. 


Application of Knowledge 


27.739 


20 


no 



Responses of teacher trainees on this item did not show a signifi- 
cant difference between the five sub-groups fgrade levels 1-3, 4-6, 7-8, 
9-12, college-other). The responses for usage items did not vary signifi- 
cantly by level taught. Therefore through the use of statistical 
inferences the investigator assumes that "grade level taught" is not a 
critical variable in teacher trainee's perception of their usage of TABA 
training. 



TABLE 5 - Urban-Rural Analysis of Questionnaire Item IV 





Chi Square 


Degrees of 
Freedom 


Significant 


VI 1 


l-A. 


Concept- Diagnosis 


10.308 


5 


no 


VI 1 


I-B. 


Interpretation of Data 


3.231 


5 


nc 


VI 1 


I-C. 


Application of Knowledge 


11.564 


5 


yes (.05) 



This analysis revealed that urban trainees perceived themselves 
as using "Applicalion of Knowledge" more than did rural teachers. 
Though not quite significant, "Concept Diagnosis" followed the same trend. 
That Is, "Application of Knowledge" is .just significant and "Concept 
Diagnosis" Is just not s ign if leant, with the point needed on the distri- 
bution chart being 11.070. 

Teaching in an urban school or a rural school is significant as 
a variable in a trainee's perception of the degree to which the trainee 
uses this component of TABA training. But it cannot thereby be assumed 
that rural teachers do not utilize their TABA training. 
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TABLE 6 - Teaching Experience Analysis of Questionnaire Item V 





Chi Square 


Degrees of 
Freedom 


Significant 


Vlll-A. Concept Diagnosis 


16,412 


10 


no 


Vlll-B. Interpretation of Data 


12.173 


10 


no 


Vlll-C. Application of Knovledge 


119.729 
■ ■ 


10 


yes (.05) 



Table 6 shows that more experienced teachers indicated a greater 
usage of 'Application of Knowledge" than did less experienced teachers. 
The statistic for "Application of Knowledge" is the largest from any sort. 
Since the less experienced teachers perceived themselves as using 
Application of Knowledge" less often than did experienced teachers, the 
investigator assumes that this particular teaching technique may be more 
difficult for inexperienced teachers. 

The technique requires the teacher to develop cr identify a 
situation to which previously studied knowledge can be applied. It can 
be inferred that TABA training is more valuable for experienced teachers. 
This IS the second most important statistic from the present study . 



- Analysis of Training Conditions (Workshop, Extension, Regular 
College Course) from Questionnaire Item VI 





Chi Square 


Degrees of 
Freedom 


Signif leant 


VI 1 1 


-A. 


Concept Diagnosis 


13.820 


10 


no 


VI 1 1 


-B. 


Interpretation of Data 


7.535 


10 


no 


VIII 


-C. 


Application of Knowledge 


13.458 


10 


no 



This table shows that the conditions of training (workshop, 
extension, or regular college course) apparently did not affect the 
degree to which TABA trainees perceived themselves as using any of the 
three parts of the TABA instruction. Several TABA trainers expressed the 
supposition that this variable would be critical, but the Inferential 
statistics do not support such an assumption. This is the third most 
important statistic from the present studv . ~ 



TABLE 8 - Analysis of Class Availability from Questionnaire Item VII 





Chi Square 


Degrees of 
Freedom 


Significant 


VIM-A. Concept Diagnosis 


9.767 


5 


no 


VIM-B. Interpretation of Data 


7.594 


5 


no 


VIM-C. Application of Knowledge 


5.191 


5 


no 



Table 8 shows that trainees who had an opportunity to use TABA 
Ideas with a class of children during their training did not perceive 
themselves as using that training to a greater extent than those who did 
not have a class to teach. Statistical Inference on this table is 
perhaps mitigated by the characteristics of the TABA instructional system 
Itself. The system requires the trainees to simulate roles of both 
teacher and student. The TABA system thus has a built-in classroom 
situation. Availability of children for use would seem to be a desirable 
training device, but the statistical inference shows that it is not a 
critical factor for subsequent perception of usage of the training. This 
is the fourth most important statistic from this study . 



TABLE 9 - Analysis of Teaching Levels (1-3, 4-6, 7-8, 9-12, College-Other) 
from Questionnaire Item It 



Quest lonnai re 
Item Number 


Variable 


Ch! Square 


Degrees of 
Freedom 


Sign if leant 


IV 


District class 
(rural -urban) 


9.334 


4 


no 


V 


Teaching experience 
(0,1,2-3,4-5,6-10,11+) 


33.749 


20 


ye5(.05) 


VI 


Training conditions 
(workshop, extension, 
regular college? course) 


27.869 


8 


yes (.05) 


VII 

1 


Chi Idren aval lab te to 
teach (yes, no) 


0.623 


4 


no 



The teaching level data sort for questionnaire Item IV shows a 
consistent cross-section of grade levels in both rural and urban groups. 



hi^K ! teach ng experience data sort shows that those teaching the 

higher grade leve s have more experience than those who teach In lower 
grade evels. All college personnel had eleven plus years experience 
which Is one reason why the sort was significant. 

The training conditions data sort shows that all college person- 
nel received training through workshops but that all other teachlna 
levels had a balance of types. 

^1%!'"^' fo*^. Shown on Table 9 shows that grade level taught did 
not affect the aval labi I Ity of chl Idren to teach during TABA training. 



10 - Analysis of District Class (Rural -Urban) on Questlonnal 
Item IV 



Questionnaire 
Item Number 


Variable 


Chl Square 


Degrees of 
Freedom 


Significant 


V 


Teaching experience 
(0,1,2-3,4-5,6-10,11+) 


2.710 


5 


no 


VI 


Training conditions 
(workshop, extension, 
regular college course) 


6.369 


2 


yes(.05) 


VI 1 


Chl Idren aval lable to 
teach (ves.no) 


5.236 


1 


yes(.05) 



It can be assumed from this table that the rural -urban factor Is 
not critical to experience for the respondents (V). 

,nr. o I. J*?® l'^^ ^\<i^^^ sort highlights the fact that urban teachers are 
more likely to receive training In extension classes, and are also more 
likely to have children available (VII) to teach during training. 

Since Tables 7 and 8 showed that neither of the two variables 
that were significant in Table 10 affect the training perception of usage, 
they are not considered to be qualitatively Important for this study 
That Is, the mode by which training took place and availability of 
children apparently are not critical Instructional variables. 
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TABLE II - Teaching Experience Analysis (0,1,2-3, 4-5, 6-10, 11+) from 
Questionnaire Item V 



Questionnaire 
Item Number 


Variable 


Chi Square 


Degrees of 
Freedom 


Significant 


VI 


Training conditions 
(workshop, extension, 
regular col lege course) 


22.866 


4 


yes(.05) 


VII 


Children available to 
teach (yes, no) 


2.809 


2 


no 



Th*j teaching experience data sort seems to 1 1 lustrate that among 
the respondents, the more experienced teachers received their training In 
workshops and the less experienced teachers received their training more 
often as part of a regular college course. 

Experience Is not a critical factor as to whether the trainees 
will have children available to teach or not. 

Table 6 showed that more experienced teachers perceived themselves 
as using their training more than did less experienced teachers. This 
could mean that workshop training is more valuable than extension or 
college course training for specific Instructional techniques. The Inves- 
tigator's personal observations and several written comments by respon- 
dents Indicated that workshop training is generally more thorough, but 
more time-consuming. This generalization cannot be established by these 
data because of the intervening variable, but might be assessed In iafer 
studies. 



TABLE 12 - Analysis of Training Conditions (Workshop, Extension, Regular 
College Course) from Questionnaire Item Vi 



Questionnaire 
Item Number 


Variable 


Chi Square 


Degrees of 
Freedom 


Significant 


VII 


Chi Idren aval labia to 
teach (yes, no) 


19.160 


2 


yes(.C5) 



Extension classes had children available In 98$ of the cases, 
while other groups were 75$ and 25%. This Is a consistent finding since 
most extension classes are comprised of practicing teachers. Not all 
workshop trainees were teaching and very few who attended regularly con- 
ducted college classes have ever taught. 
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General Observations Ra sed Upon Data Sorts and Statistical Analysis 



The most significant fact to emerge from the chl square statisti- 
cal tabulation was that those trainees who had more teaching experience 
perceived themselves as using TABA techniques mere frequently than did 
less experienced teachers, see Table 13. 



TABLE 13 - Analysis of Respondents' Years 
of Teaching Experience 



Years Experience 


Number 


Percent 


0 


11 


3.9 


1 


14 


5.0 


2-3 


44 


15.6 


4-? 


48 


17.0 


6-10 


68 


24.0 


1 1 or more 


97 


34.3 



Data frcxn Table 13 add Importance to the perceived usage of the 
more experienced teacher. There were more TABA respondents In the more 
experienced categories (six or beyond) and fewer respondents In the less 
experienced categories. The Investigator assumed that more of those 
teachers who benefit maximally from the training, are receiving the 
training. The validity of the assumption, of course, needs testing. 

Aside from the above, none of the other statistical data sorts 
revealed Information that would be of value to the planning of college or 
In-service teacher training. All teaching levels, all trained under any 
of the three training conditions, all who had children available or did 
not, seemed to have profited about equally from their training. The 
Investigator concludes that prer^ent methods of disseminating tne TABA 
training program are adequate If more widespread dissemination of TABA 
Is not undertaken. This Is discussed In the recommendations below. 



Recommendations Based Upon Statistical Analysis 

1. Experienced teact ers tend to use their training m* re thar 
Inexperienced teachers. If decisions need to be made about 
resource alloc ation of TABA training, such resources should 
be allocated to training experienced teachers > 
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EMC 



2. If It does not Interfere with training of experienced 

teachers, the reqlon^s colleges and universities and/or the 
NWREl should make greater efforts to train those who train 
teachers In TABA techniques . 

3« Because the data from the present study confirms the NWREL's 
position about the efficacy of TABA as an Instructional 
system, school districts should provide the opportunity for 
all teachers to receive TABA training . This study and the 
NWREL 's studies together provide a strong initial set for 
adoption by all school districts. School districts should 
provide adequate rewards for ail teachers who oomplete TABA 
trainlnq . 



Suqqestlon For Further Studv 

Workshop training seems to have a positive effect on usage of 
training, probably due to more comprehensiveness, but possibly also 
because of a greater number of experienced teachers. Since this Is not 
directly verifiable by the data, it cannot be offered as a definite 
recommendation. 



Recommendations Based Upon Respondent "Comments" (See Appendix F) 

1. Many respondents expressed a desire for additional TABA 
training. Advanced TABA training should be provided by 
school districts^ possibly on a consolidated level . 

2. Large numbers of respondents commented upon the value of 
TABA questioning strategies. Unless the NWREL has contrary 
data on their Questioning System^ TABA training should 
receive dissemination priority over the Ouestlonlnq System. 

3. The investigator can provide the basic material for compiling 
a mailing list for TABA trainees. Because many respondents 
expressed a need or a desire for additional Ideas and materials 
for TABA usage, the NWREL and/or the reo ion's colleges or 
universities should provide a n Idea exchange and news letter 
for TABA trainees. ^ 
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Chapter 1 1 1 



SUMMARY OF THE STUDY—RUPS 



General Findings from Survey 

Analysis of data from the RUPS trainer survey showed that those 
trainers who responded to the questionnaire perceived themselves as 
using the RUPS system substantially as it is disseminated by the NWREL; 
therefore all trainee responses are treated uniformly. If a trainer had 
perceived herself or himself as omitting or substantially changing any 
of the essential components of the RUPS instructional system, the data 
from those trainees who had received such revised training would have 
been computed separately from those trainees who received the complete 
program. 

Since the primary purpose of the RUPS investigation was to determine 
the perceptions of the classroom teachers as to their utilization of 
their training, the general findings of this section of the study are 
discussed first. The questionnaire items on usage follows. 

The responses to the items on classroom usage are shown with their 
percentages in Table 14. 



TABLE 14 - Total and Percentage of Teacher Responses-Questionnaire Item 
Vlll-A Problem Identification 





Number Responding 


Percent Responding 


Never 


29 


16.8 


Once since training 


7 


4.0 


A few times 


115 


66.5 


1 /month 


13 


7.5 


1 /week 


9 


5.2 


1/day 


0 


0.0 


TOTAL Responding 


173 


49.5 



From the data In Table 14 it appears that "Problem Identifica- 
tion" was used by the respondents rather infrequently, depending upon 
the criterion to be used, e.g. once a month or more often. 
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TABLE 15 - Total and Percentage of Teacher Responses— Questionnaire 
Item Vlll-B Research Utilization 





Number Responding 


Percent Responding 


Never 


53 


30.5 


Once since training 


7 


4.0 


A few times 


95 


54.6 


1 /month 


13 


7.5 


1/week 


6 


3.4 


1/day 


0 


0.0 


TOTAL Responding 


174 


95.1 



Again, from the data in Table 15 it would seem that "Research 
Utilization" is used infrequently by the respondents, i.e,, usually less 
than once a month. 



TABLE 16 - Total and Percentage of Teacher Responses — Questionnaire Item 
Vlll-C Force Field Analysis 





Number Responding 


Percent Responding 


Never 


68 


39.5 


Once since training 


13 


7.6 


A few times 


80 


46.5 


1 /month 


9 


5.2 


1/week 


2 


1.2 


1/day 


0 


0.0 


TOTAL Responding 


172 


94.0 



The use of "Force Field Analysis" by the respondents tended to 
follow the pattern of infrequent use. 
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TABLE 17 - Total and Percentage of Teacher Responses — Questionnaire 
Item VMI-D Teamwork Relationships 





1 

Number Responding 


Percent Responding 


Never 


75 


43.6 


Once since training 


11 


6.4 


A few times 


71 


41.3 


1 /month 


7 


4.1 


1/week 


8 


4.7 


1/day 


0 


0.0 


TOTAL Responding 


172 


94.0 



From the data reported In Table 17 it would appear that "Team- 
work Relationships" is also used rather Infrequently by the respondents. 
However, there was a slight Increase at the weekly or monthly levels 
when compared to "Force Field Analysis," Table 16. 



TABLE 18 - Total and Percentage of Teacher Responses— Questionnaire 
Item Vlll-E Data-gathering Skills 





Number Responding 


Percent Responding 


Never 


57 


33.3 


Once since training 


• 10 


5.8 


A few times 


88 


51.5 


1 /month 


9 


5.3 


1 /week 


7 


4.1 


1/day 


0 


0.0 


TOTAL Responding 


171 


93.4 



The pattern of responses for "Data-gathering Skills" follows 
closely those reported in Tables 14, 15, 16 and 17. That Is, there Is 
infrequent use of the specific skill. 
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TABLE 19 - Total and Percentage of Teacher Responses— Quest ton na I re 
Item VII l-F Tool Selection 





Number Responding 


Percent Responding 


Never 


59 


35.3 


Once since training 


9 


5.4 


A few times 


87 


52.1 


1 /month 


8 


4.8 


1/week 


4 


2.4 


1/day 


0 


0.0 


TOTAL Responding 


167 


91.3 



"Tool Selection" seemed to be used rather Infrequently by the 
respondents, as may be observed from data in Table 19. 



TABLE 20 - Total and Percentage of Teacher Responses — Questionnaire 
Item Vlll-G Implications Derived 





Number Responding 


Percent Responding 


Never 


69 


42.6 


Once since training 


9 


5.6 


A few tirr:; 


72 


44.4 


1 /month 


9 


5.6 


}/vieek 


3 


1.9 


1/day 


0 


0.0 


TOTAL Responding 


162 

J 


88.5 



The data In Table 20 tend to show that the techniques associated 
with "Implications Derived" were used Infrequently by the respondents. 
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TABLE 21 - Total and Percentage of Teacher Responses—Questionnaire 
Itern Vlll-H Planning for Action 





Number Responding 


Percent Responding 


Never 


45 


27.4 


Once since training 


7 


4.3 


A few times 


92 


56.1 


1 /month 


11 


■ 

6.7 


1/week 

1 


9 


5.5 


1/day 


0 


0.0 


1 

TOTAL Responding 


164 


89.6 



Techniques associated with "Planning for Action" appeared to 
be used more frequently by the respondents than the previously reported 
skills as Is shown by data In Table 21. 



TABLE 22 - Total and Percentage of Teacher Responses—Questionnaire 
Item Vlll-I Small Group Dynamics 





Number Responding 


Percent Responding 


Never 


52 


31.5 


Once since training 


8 


4.8 


A few times 


76 


46.1 


1 /month 


12 


7.3 


1/week 


17 


10.3 


1/day 


0 


0.0 


TOTAL Responding 


165 


90.2 



The single concept to which the respondents noted greatest use 
was "Small Group Dynamics." Compare the data In Table 22 with Tables 
14 through 21 to note the reported Increased use. 
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Table 23 below shows the average usage figures for all RUPS 
trainee respondents. The usage Items were averaged horizontally for 
all teacher responses on Items VI ! I-A through Vlll-I. It can be 
observed that there was reported rather Infrequent use of the techniques. 



TABLE 23 - Average Percentage of Teacher Trainees 

Responding to Items VI I I-A through VI 1 1- 1 



Item Category 


Percent Responding 


Never 


33.4 


Once since training 


5.3 


A few times 


51 .0 


1 /.nonth 


6.0 


1 /week 


4.5 


I/day 


0.0 


TOTAL 


100.2 



i. 



The avera ge percentage figures from Table 23 above are the most 
Important set of stat istics from the RUPS survey . The Investigator con- 
cluded from these data that the RUPS system does have a significant 
Impact upon teacher trainees, that Is, RUPS seems to be used by 
these teacher respondents. The Item category "a few times" containing 
51% of ail trainees would mean that those who checked this response for 
each of the nine components perceived themselves as using each of the 
components a "few times." If those respondents who marked the next two 
categories, "monthly" or "weekly" are added to those who marked "a few 
times" the total for those who perceive themselves as using their train- 
ing In the classroom is 61. 5^. This could be considered as a high degree 
of usage since none of the components of the RUPS system are Intended to 
be used on a dally basis. They are not Instructional methods, but are 
diagnostic and evaluation skills. But If the criterion measure were 
monthly use or more frequently then It must be concluded that the RUPS 
system techniques are used very infrequently by the respondents. 

All usage figures are mitigated by the fact that If those who 
marked that they used each Item monthly, perceived themselves as using 
each RUPS component monthly, then there would be nine usages, l-lcwever, 
this conclusion Is not supported by data— but may be staled as an 
Inference. 
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Item IX on the RUPS Questionnaire was designed to test the 
attitudes of the trainees toward their training. The statement read as 
fol lows: 

IX, Please check one of the following statements concerning 
how you feel about the RUPS training program, 

1. I think the RUPS program was a waste of time, 

2. I think It had some small value to me as a person, 

3, I think It was valuable to myself and other persons 
In the workshop. 

4, I think It Is a very valuable program, ^ 

The tabular results of this Item are shown In Table 24, 



TABLE 24 - Number and Percentages of Teacher Trainees Responding to Item IX 





Number Responding 


Percent Responding 


1. Waste of time 


18 


10.2 


2. Some smal 1 value 


61 


34.7 


3. Valuable 


75 


42.6 


4. Very valuable 


22 


12.5 


TOTAL Responding 


176 


96.2 



^ * "^^^^ 23 and 24 above. It seems evident that 

J^n?! "-espondents who do not perceive themselves as using the 
wis o]\^o f ^"1^°°!? heless perceived that the RUPS workshop 
?Jhi!c small value" or "valuable." The figures from these two 

lo^^LJ?;; H H? +°,^"PP°'^ +he NWREL's assumption that ther« Is evidence 
J?;h?^! T^5'"*"'"^^'°" °^ f^PS Instructional system. These 
findings should cause concern for those who are proponents of total 
teacher competency based evaluations. 



Chi square Analysis 

Data tabulation for the RUPS system Is Included to show how 
the respondents reacted to the questionnaire Items. Data sorts were 
Z^JyZ 5 H particular sort, questions were 

analyzed to determine If the sort groups responded similarly or not to 
each respective question. The statistical test used was a two-way 
contingency table for the chl square treatment. If the statistic 
computed Is smaller than the tabular value, the hypothesis can be accepted 
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that the groups being tested are compatible. If the statistic Is greater 
than the tabular value, the groups are deemed Incompatible. The level of 
significance used throughout Is .05, a conventional choice. 

After the sorts were made, each of the six demographic data 
groups from Table 24 were set up on contingency tables with each of the 
nine usage Items (VIII A-l), and also with each other, to determine If 
the resulting figures showed that the differences were critical under 
the .05 level of significance. 

The chl square distribution table of values Is shown In Chapter 
II, Table 3, Page 13. 



TABLE 25 - Chl Square Analysis for Teaching Level —(Questionnaire 

Item II with all usage Items—Questionnaire Items VIII A-l) 



item Number 


Variable 


Chl Square 


Degree of 
Freedom 


Significant 


vm-A 


Identifying Problems 


15.642 


12 


no 


Vlll-B 


UtI 1 Izing Research 


7.670 


12 


no 


Vlll-C 


Force Field Analysis 


10.320 


9 


no 


VJI l-D 


Teamwork Relationships 


21 .929 


12 


yes (.05) 


Vlll-E 


Data-Gathering Skills 


7.671 


12 


no 


Vlll-F 


Tool Selection 


10.306 


9 


no 


Vlll-G 


Deriving Implications 
and Alternatives 


4.812 


12 


no 


Vlll-H 


Planning for Action 


8.356 


12 


no 


Vlil-I 


Small Group Dynamics 


10.743 


12 


no 



Table 25 shows one significant difference. Teamwork Relationships . 
The significant difference which resulted Is that respondents teaching In 
Grades 9-12 reported not using this particular skill at all. All of the 
other skills were evenly distributed throughout the grade levels. It 
can therefore be assumed that Grade Level Taught Is not a significant 
variable for trainee perception of classroom usage In grades below the 
ninth. Had this difference shown up for more than one out of the nine 
components, a generalization might have been made. But, It might be 
cautiously generalized that high school teachers did not use team build- 
ing strategies. This may have been caused by lack of team teaching 
environments. 

Tho usage sort for Questionnaire Item IV (Rural-Urban) showed no 
statistical significance. It can be assumed that this variable Is not 
significant for trainee perception of classroom usage. 
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- Chi Square Analysis for Teaching Experience (Ouestionnaire 
Item V) with all usage items (Questionnaire Items VIII A-l) 



Item Number 


Variable 


Ch i Square 


Degree of 
Frsedcfn 


Significant 


VII l-A 


Identifying Problems 


23.279 


8 


yes(.05) 


VI 1 l-B 


Uti 1 izing Research 


14.426 


8 


no 


VII l-C 


Force Field Analysis 


9.318 


6 


no 


VI 1 l-D 


Teamwork Relationships 


14.746 


8 


no 


VI 1 l-E 


Data-Gathering Ski 1 Is 


7.049 


8 


no 


VI ll-F 


Tool Selection 


12.510 


8 


no 


VII l-G 


Deriving Implications 
and Alternatives 


6.066 


6 


no 


VI 1 l-H 


Planning for Action 


11.210 


8 


no 


VI ll-l 


Small Group Dynamics 


11.711 


8 


no 



The data In Table 26 show little variation; the one significant 
variable being Identifying Problems . Trainees from the first two 
experience categories (lesser experience) apparently used this particular 
skill with less frequency than did those in the more experienced 
categories. With that single exception, it can be assumed that Experl- 
ence is not a critical variable in the perceived usage of all RUPS skills 
in the classroom. Because of the Importance of experience to the TABA 
system described in rha pter II. the fact that it does not seem to be as 
critical in the RUPS system is considered to be the second most Importan t 
statistical finding from the RUPS survey" ' 
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TABLE 27 - Chi Square Analysis for Training Conditions (Questionnaire 
Item VI) with all usage Items (Questionnaire Items VIII A-l) 



Item Number 


Variab le 


Ch i -Square 


Degree of 
Freedom 


Signi f leant 


VI 1 l-A 


Identifying Problems 


4.294 


8 


no 


V 1 1 1 -B 


UtI 1 izing Research 


3.754 


8 


no 


VI 1 l-C 


Force Field Analysis 


3.223 


6 


no 


VI 1 l-D 


Teamwork Relationships 


6.740 


8 


no 


VI 1 l-E 


Data-Gathering Ski 1 Is 


3.959 


8 


no 


Vlll-F 


Tool Selection 


7.099 


8 


no 


VI 1 l-G 


Deriving Implications 
and Alternatives 


5.433 


6 


no 


VI 1 l-H 


Planr, ig for Action 


5.633 


8 


no 


VII l-l 


Small Group Dynamics 


7.045 


8 


no 



Table 27 presents data which show that whether a teacher is 
trained In RUPS under workshop, extension, or a regular college course, 
has no significant effect on their use of the RUPS skills in the class- 
room. This Is the third most important set of statistical inferences 
drawn from the RUPS survey. Suppositions were stated by some RUPS 
trainers that there would be a critical difference on this variable. 
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TABLE 28 - Chi Square Analysis for Class Availability (Questionnaire 

Item VII) with all usage Items (Questionnaire Items VIM A-l) 



Item Number 


Variable 


Chi Square 


Degree of 
Freedom 


^ Inn If lrAn+ 


VI 1 l-A 


Identifying Problems 


3.700 


4 


no 


VI 1 l-B 


UtI 1 Izing Research 


1 1 . 648 


4 


woe 

yes 


VI ll-C 


Force Field Analysis 


5.878 


4 


no 


VII l-D 


Teamwork Relationships 


5.041 


4 


no 


Vlll-E 


Data-Gathering Ski Ms 


0.990 


4 


no 


VI 1 l-F 


Tool Selection 


4.958 


4 


no 


VI 1 l-G 


Deriving Implications 
and Alternatives 


4.721 


4 


no 


VI 1 l-H 


Planning for Action 


5.092 


4 


no 


VI ll-l 


Small Group Dynamics 


3.072 


4 


no 



The data In Table 28 show one significant dif ference^ -Utl I Iztnq 
Research. Those respondents who had classes of pupils available to 
teach during the time they received their RUPS training used this par- 
ticular skill significantly more frequently than those who did not. 
Because this difference appeared In but one of the nine components, no 
valid generalization can be derived from this set of statistics. In 
spite of the one critical category, the availability of a class to 
teach during RUPS training did not seem to affect respondent perception 
of usage In any Important way. 

The tables from the demographic data sorts are not shown In this 
report because none of them revealed any statistical differences. 

Generally, the RUPS chl square analyses showed little dispersion, 
that Is, ^-he Investigator could not Isolate any critical statistically 
significant variable. None of the six demographic variables significantly 
affected how teacher respondents perceived themselves when using their 
training. 
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Observations and R ecommendations Based Upon "Consents by Respond ents—- 
WJPS^ (See Appendix G) 

1. Many respondents commented upon the shortness of time of 
RUPS workshops. As can be observed from the selected 
comments In Appendix G, these respondents expressed a desire 
for more detailed development of RUPS components, for more 
opportunity to practice RUPS skills, and for some type of 
follow-up program. 

Recommendation 



The RUPS Instructional System needs to be less Intensive; either 
the systefn should be shortened, or the duration of the workshop should be 
extended. The NWREL and/or the region's colleges and universities should 
develop and disseminate a follow-up workshop for RUPS trainees, probably 
on a consolidated district basis. 

2. The Force Field Technique seems to be the most remembered and 
used aspect of the RUPS system. This observation Is not born 
out statistically, but comments seem to justify this conclu- 
sion. Many administrators seem to have adapted Force Field 
Andlysls to their work but their questionnaires were not part 
of the statistical program for this present Investigation. 

3. RUPS seems to be an effective means for awakening teachers 
to techniques for handling small groups within the classroom. 

4. Depending on the criterion of use, RUPS appears to be used 
less frequently as a technique than was the TA8A training. 
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Chapter IV 
SUMMARY AND RECOMMENDATIONS 

Purpose 

The purpose of this study was to evaluate the use and type of 
training received by teachers for two Instructional systems developed 
by the Northwest Regional Educational Laboratory of ft)rt!and, Oregon* 
The systems were "Development of Higher Level Thinking Abilities" (TABA) 
and "Research Utilizing Problem Solving" (RUPS). 

The objectives were to: 

1. Determine the extent of use of the systems within the area 
served by the Northwest Regional Educational Laboratory: 
Alaska, Idaho, Montana, Oregon, and Washington. 

2. Establish whether or not the teacher training program actually 
being taught by TABA and RUPS trainers and the Instructional 
systems being produced by the Laboratory were essentially 

the same. 

3. Analyze data gathered by the Instruments devised, drawing 
generalizations and conclusions concerning the value of the 
systems for teacher training. 

4. Develop lnstrumen•^- to assess the extent of use of TABA and 
RUPS by persons ;ho were trained under these systems. 

All data were gathered through a mall questionnaire. 
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Summary 

The following constitute the major findings of this study. 

1. Experienced teachers tended to use the TABA training more 
than Inexperienced teachers. 

2. Many respondents expressed a desire for additional TABA 
train 

3. Many respondents commented on the value of the TABA questioning 
strategies. 

4. The RUPS training was utilized by respondents, but there 
tended to be lesser use than with the TABA program. 

Recommendations 

The following reconmendatlons pertain to the TABA and RUPS 
systems which were the subject of investigation. 

1. If decisions need to be made about resource allocation of 
TABA training, such resources should be allocated to training 
experienced teachers. 

2. Because the data from the present study confirms the NWREL's 
position about the efficacy of TABA as an instructional 
system, school districts should provide the opportunity for 
ail teachers to receive TABA training. This study and the 
NWREL*s studies together provide a strong Initial set for 
adoption by all school districts. School districts should 
provide adequate rewards for a 1 1 teachers who complete TABA 
training. Advanced TABA training should be provided by 
school districts, possibly on a consolidated level. 
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It appeared that the RUPS program might be more appllcabia 
to administrators. It Is recomnended that the NWREL compare 
the generallzablllty of RUPS to teachers and administrators. 
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APPENDIX A 



LETTER OF INQUIRY REQUESTING NAMES 
AND ADDRESSES OF RUPS AND TABA TRAINEES 
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WASHINGTON STATE UNIVERSITY 

PULLMAN, WASHINGTON 99163 

DEPARTMENT OF EDUCATION 



S!.?®'^!r^"*"t ?^ Education Is sponsoring a research study entitled 
we^^ oSI^H°' '"^I''"^r'°"«' Systens RUPS and TABA." TheL progr^ 
were offered as extension courses, as regular college courses or « 
spec al workshops for teachers. The exa?t program titles arl'-T^e 

S?M ?fri 1-^^' "^'"'^'"9 Abllltfes" (TABA) and "Resl^ch 

UtIIIzng Problem Solving" (RUPS). Both programs wer*^ developed and 

fi'lSr^H*^ '^■'^'^'^'^ '^S'^"^' Educational Labor^^or?'7oca?ed 

iSlSrir ;. ^° "^'^!! ^^'^ ^+"^y' "-"St ma7l question 

nalres to all persons who have completed either of these two oroarams 

W© kindly request that you send us the names and addresses of all such 
persons who completed these programs during the period |^lc?f fed. 

iJo^?3L?el! ^''^"^ °^ +he person 

at?«S^H !hf!+ ^? '"stitutlon Is Included on the 

attached sheet. If necessary, course numbers, credit hours and other 

iSoar^lSl r Ppf^'r '° Chairman of your E^ucIJton 

rJ'^J^r^l; ni^"^ :^'! '"formation on the forms provided and 
In the self-addressed stamped return envelope to: 

Phillip M. O'Neill 
Project 68 Director 
4515 N. A Street 
Spokane, WA 99205 

Thank you very much for your cooperation. 

Respectfully yours, 

Donald C. Orllch 
Professor of Education 




Phil lip M. O'Neill 
Project 68 Director 



WASHINGTON STATE UNIVERSITY 

PULLMAN. WASHINGTON 99168 



DEPARTMENT OF EDUCATION 



Washington State University, In cooperation with the Northwest 
Regional Educational Laboratory and under the sponsorship of the United 
States Office of Education, Is conducting a research study entitled 
"Evaluation of Instructional Systems RUPS and TABA." The purposes of 
this study are to: 

1. Determine the extent of use of these systems within the 
area served by the Northwest Regional Educational Laboratory: 
Alaska, Idaho, Montana, Oregon, and Washington. 

2. Establish the degree of conformity between the teacher 
training programs being taught by TABA and RUPS trainers and 
the Instructional systems being produced by the Laboratory. 

3. Analyze data gathered by Instruments which draw generaliza- 
tions and conclusions concerning the value of the system for 
teacher training. 

Before a survey of trainees can be undertaken. It Is necessary that 
the qualified trainers like yourself respond to the enclosed Instruments. 
Would you help us with this study by completing one of the enclosed 
checklists for each TABA training session which you conducted between 
target dates June 1, 1969 and August 30, 1970? Please return the forms 
as soon as possible In the enclosed stamped, self-addressed envelope. 
Your help Is very much needed and appreciated. 

Respectfully, 



Phillip Mike O'Neill 

Director 

Project 68 

Enclosures 



PMO:DCO:clb 



Training session dates: From | | To 
Approximate Number of Trainees 



Type of training session (Please Check) 

I. Intensive Workshop 2. Protracted Extension Course 3. Regular College Course 

During this training session did you omit or modify any of the subsets for the three principal components of TABA? 
I. Yes 2. No 

If you answered Yes totfiTe above please complete the rest of this page. Write any comments that you wish on the 
back of this sheet. Reference subset number. Please check appropriate block. 



Subset 


ouuaci ui (.AJiTiponeni i^ame 


Modification Status 


(1) 
Omitted 


12) 
Changed 


(3) 

Used as Presented 


Comments on Back? 
(Yes or No) 




Concept Diagnosis 










1 


Sensitivity 










2 


Processes 










3 


Exercises 










4 


Demonstration 










5 


Typescript Analysis 










6 


Laboratory Experience 












Interpretation of Data 










7 


Sensitivity 










8 


Processes 










9 


Exercises 










10 


Laboratory Experience 










11 


Films 












Application of Knowledge 










12 


Sensitivity 










13 


Processes 










14 


Exercises 










15 


Demonstration 










16 


Laboratory Experience 











Please comment on what you think Is the value of the TABA system. What Improvements do you think could be made? 
Use back of sheet. 



WASHINGTON STATE UNIVERSITY 

PULLMAN. WASHINGTON 9916S 



DEPARTBfENT OF EDUCATION 



Washington State University, In cooperation with the Northwest 
Regional Educational Laboratory, Is sponsoring a research study 
entitled "Evaluation of Instructional Systems RUPS and TABA." You 
are listed by your college as having received training under the 
system "Development of Higher Level Thinking Abilities" (TABA). We 
know that the only ones who can accurately assess this program are 
those like yourself who have had the opportunity to take this train- 
ing, and who have had the experience of applying your training. 

You can help us In this badly needed research by completing 
the enclosed checklist and returning It to us In the enclosed 
stamped envelope. Your prompt response will help us to complete 
this study, which will assist your school district, your college, 
and the Laboratory In their planning for future teacher education 
programs . 

Sincerely yours. 



Phillip Michael O'Neill 
Project Director 



As we have no record of your present position, check each statement below: 

I. The majority of my educational duties are as a: 

1. Teacher 3. Administrator 

2. Counselor 4. Other (specify) 

If you die not check No. 1 above, that is if the majority of your educational duties are not as a classroom 
teacher, disregird the questions and statements below, but feel free to make any comments that you wish 
regarding your training in the spaces provided and return it to us. 

All teachers please complete the follow mg items: 



n. The majority of my classroom duties are in the grade level: 

1. Grades 1-3 Comments 

2. Grades 4-6 

3. Grades 7-8 

4. Grades 9-12 

5. College 



6. Other (specify) 

in. Your sex: 

1. Male 2. Female 

IV. I teach in a school that would be classified as: 

1. Mainly rural Comments 

2. Mainly urban 

V. At the time of your training, how much teaching experience had you had? 

1. None Comments 

2. One year ^— 

3. Two to three years 

4. Four to five years 

5. Six to 10 years 



6. 1 1 or more years 

VI. Under what conditions did you receive your training? 

1. Intensive workshop Comments 

2. Protracted through extension course 

3. During regular college course 

VII. At the time of your training, did you have a class of children available to you so that you could try out 
the principles and ideas presented by the instructor? 

1. Yes Comments 

2. No 

VIII. Please respond to each of the following statements as you perceive yourself using the processes and ideas 
learned during your TABA training. 

A. To what extent have you used the processes and ideas in "Concept Diagnosis" in your classroom since 
you received your TABA training? 

1. Never Comments 

2. Once since the training 

3. A few times 

4. Once a month 

5. Once a week 



6. One or more times daily 



B. To what extent have you used the processes and ideas in 'interpretation of Data" in your classroom 
since you received your TABA training? 

1. Never Comments 

2. Once since the training . 

3. A few times 

4. Once a month 

5. Once a week 



6. One or more times daily 



(over) 



-2- 



C. To what extent have you used the processes and ideas in "Applicatiot of Knowledge* in your class- 
room since you received your TABA training? 

1 ^«ver Comments 

2. Once since the training — ^— 

3. A few times 

4. Once a month 

5. Once a week , 

6. One or more times daily 

IX. Please add any additional comments which you may have below. 



APPENDIX C 

RUPS TRAINER AND TRAINEE COVER LETTERS AND QUESTIONNAIRES 



WASHINGTON STATE UNIVERSITY 

PULLMAN, WASHINGTON 9916$ 



DEPARTMENT OF EDUCATION 



Washington State University, in cooperation with the Northwest 
Regional Educational Laboratory and under the sponsorship of the United 
States Office of Education, is conducting a research study entitled 
"Evaluation of Instructional Systems RUPS and TABA." The purposes of 
this study are to: 

1. Determine the extent of use of these systems within the 
area served by the Northwest Regional Educational Laboratory: 
Alaska, Idaho, Montana, Oregon, and Washington. 

2. Establish the degree of conformity between the teacher 
training programs being taught by RUFS and TABA trainers and 
the instructional programs being produced by the Laboratory. 

3. Analyze data gatnered by instruments which draw generaliza- 
tions. and conclusions concerning value of the systems for 
teacher training. 

Before the survey of trainees can be undertaken, it is necessary that 
the qualified trainers like yourself respond to the enclosed instruments. 
Would you help us with this study by completing one of the enclosed check- 
lists for each RUPS training session which you conducted between the 
target dates June 1, 1969 and August 30, 1970? Please return your lists 
as soon as possible in the enclosed stamped, self-addressed envelope. Your 
help Is very much needed and appreciated. 

Respectfully, 



Phillip Mike O'Neill 

Director 

Project 68 

Enclosures 



PMO:DCO:clb 



TraMni mriM dun: From | | 
Appfwlmaii Numtar off TriinMi 



Durlni tfw «oum of Mi worktop dM you emft or iMdW^ 

«dMlop«lMddMn«Miby«wNoril^ ,.No 

Wrhi«»»ooiiwiWi515tvou5Broo 
AtkMkoffMiAMt RtlMWMSuiMtUttir. Hmn dMck mpriM Mock. 



SubMt 


SliOMt NWW 


ModMcotkn Statua 




11) 

OfRftlMl 


CNngad 




1 

— Aa^l 


A 


wTwntsdon 










■ 


MHitifyinattitFvobiwi 










C 


U*i| RoMmh Abeot ttM OMreom 










0 


(Mn( tfw Foroo FMd TodrnkuM 








• 


f 


OinnoilniToMiMiork RiMofMMpi 










F 


OMi GMlMrini Sklib 










0 


SriogUng Took for Oati QMhorini 










H 


Spottim IMor HowNi In Ons 










1 


Group MMibtr Rftingi 










J 


Tht FMdbMfc Conomi 










K 


OwMnf ImplldtkMi ft Action AltMiiotivM 










L 


Flannini for Action 










M 


•rnoN Group OvnamiM 










N 


Ftomhii Your Btck-Honw RUPS 










0 


Follow-Throu^ No. 1 










F 


Follow<Throush No. 2 










2. 


Plwn oonmant on what you tftk* b Km voKm of tSt RUPS lyi 
MnkeouW tornado? Uw book of diaot H nndid. 






MMMfMi dtt Mfiil 



DEPARTBCENT OF EDUCATION 



Washington State University, In cooperation with the Northwest 
Regional Educational Laboratory, Is sponsoring a research study 
entitled "Evaluation of Instructional Systems RUPS and TABA." You 
are listed by your college as having received training under the 
system "Research Utilizing Problem Solving" (RUPS). We know that 
the only ones who can accurately assess this program are those like 
yourself who have had the opportunity to take this training, and 
who have had the experience of applying your training. 

You can help us In this badly needed research by completing 
the enclosed checklist and returning It In the enclosed stamped 
envelope. Your prompt response will help to complete this study, 
which will assist your school district, your college, and the 
Laboratory in their planning for future teacher education programs. 
A brief summary of the '^JPS training is enclosed for your review. 

Sincerely yours. 



Phillip Michael O'Neill 
Project Director 



As we have no record of your present position, check each statement below: 



I. The majority of my educational duties are as a: 

1. Teacher 3. Administrator 

2. Counselor 4. Other (specify) 

If you did not check No. 1 above, that is if the majority of your educational duties are not as a classroom 
teacher, disregard the questions and statements below, but feel free to make any comments that you wish 
regarding your training in the spaces provided and return it to us. 

All teachers please complete the following items: 

II. The majority of my classroom duties are in the grade level: 

1. Grades 1-3 Comments 

2. Grades 4-6 

3. Grades 7-8 

4. Grades 9-12 

5. College 



6. Other (specify) 

III. Your sex: 

1. Male 2. Female , 

IV. I teach in a school that would be classified as: 

1. Mainly rural Comments 



2. Mainly urban 



V. At the time of your training, how much teaching experience had you had? 

1. None Comments 

2. One year — — ^— 

3. Two or three years 

4. Four or five years 

5. Six to 10 years 



6. 1 1 or more years . 



VI. Under what conditions did you receive your training? 

1. Intensive workshop Comments 

2. Protracted through extension course 

3. During regular college course 

VII. At the time of your training, did you have a class of children available to you so that you could try out 
the principles and ideas presented by the instructor? 

1 . Yes Comments 

2. No 

VIII. Please respond to each of the following statements as you perceive yourself using the principles and tech- 
niques of your RUPS training in your work as a classroom teacher. 

A. I have used the RUPS proce(«ure for identifying problems in the classroom. 

1. Never Comments 

2. Once since the training 

3. A few times 

4. Once a month 

5. Once a week 



B. I have used the RUPS procedure for utilizing research about the classroom. 

1. Never Comments 

2. Once since the training 

3. A few times 



4. Once a month 

5. Once a week _ 



I have used the RUPS technique of Force Field analysis with my classes. 

1 . Never Comments 

2. Once since the training 

3. A few times 

4. Once a month 

5. Once a week 



(over) 
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D. I have used the RUPS technique for diagnosing teamwork relationships. 

1. Never Comments 

2. Once since the training " 

3. A few times 

4. Once a month 

5. Once a week 



E. I have used RUPS data-gathering skills in the classroom. 

1. Never Comments 

2. Once since the training ' 

3. A few times 



4. Once a month 

5. Once a week _ 



I have selected tools for data-gathering according to the RUPS procedure. 

1. Never Comments 

2. Once since the training 

3. A few times 

4. Once a month 

5. Once a week - 



G. I have derived implications and alternatives from research findings using RUPS procedures. 

1. Never Comments 

2. Once since the training 

3. A few times 

4. Once a month 

5. Once a week 



H. I have used RUPS skills in planning for action in the classroom. 

1. Never Comments 

2. Once since the training 

3. A few times 

4. Once a month 

5. Once a week 



I have used the RUPS technique of small group dynamics within my classroom. 

1. Never Comments 

2. Once since the training 

3. A few times 

4. Once a month 

5. Once a week 



IX. Please check one of the following statements concerning how you feel about the RUPS training program. 

1. I think the RUPS program was a waste of time. 

2. I think it had some small value to me as a person 



3. I think it was valuable to myself and other personc in the workshop. 

4. I think it is a very valuable program. 

X. Please add any additional comments which you may have below. 



Here Is a brief outline of the steps In RUPS training. Each Item on the 
questionnaire to which you will respond is described below: 



Item VI 1 1 



A. Participants wrote a statsmenf of the problems In Mrs. Jones' classroom. 
"Paraphrasing" skills were Introduced. 

B. Participants were asked to rewrite problem statements Incorporatinq I^slqhts 
from Research Findings handouts. 

C. Participants were asked to write a force field diagnosis of Mrs. Jones' 
problems and to compare It with Mrs. Jones' own force field diagnosis. 

0. Participants worked In trios developing force field diagrams to Increase 
effectiveness of trio's teamwork. 

E. Participants rated and ranked force field Items for data gathering. 

F. Participants explored application of force field analysis to selection of 
different kinds of data gathering Instruments such as Complete a Sentenc e 
or Preferred a Choice . 

G. Participants analyzed major results of applying data gathering Instruments 
with the view of revising the force field. 

H. Participants Identified and wrote questions for getting Information required 
In two categories: I) supportive resources, 2) management considerations; 
and performed a force field analysis on the first action step In Mrs. Jones' 
action plan. 

1. Part Id par. -Irs read the RUPS handout Five Dimensions of Group Growth , and 
scanned Ideas In Dlaonoslnn Classroom Learning Fn>/irr.nri>«nte , and then 
rated and Interpreted their own small group's growth! 
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400 Lindsay Building • 710 S.lf. Second Avenue 
Portland, Oregon 97204 • Telephone (503) 224-3650 



September 29, 1970 



Mr. Phillip M. O'Neill 
4515 North A Street 
Spokane, Washington 
99205 



Dear Mr. O'Neill: 

The Research and Evaluation Division of the Northwest Regional Educational 
Laboratory is supportive of and open to collaboration with your study 
of utilization and spread of training in Research Utilizing Problem 
Solving and Higher Level Thinking Abilities as these have been taught 
by instructors in your institution. 

We have already provided you with instruments developed specifically 
to test cognitive and/or behavioral performance in the key conceptual 
and action skill dimensions of the training program and offered to 
make available cognitive data from our own evaluation studies. If 
you decide to use these materials data reduction formats, and codes 
will be made available. 

We expect in return, that you will assess the degree of conformity of 
the teaching program to the Instructional system produced by this 
Laboratory. We make no claims as to outcome if the instruction deviates 
from the system as designed and tested. While we remain willing to 
assist others in evaluating variations and deviations we insist that 
such variations and changes be clearly described and that outcomes be 
related to the training as given rather than to our product when it is 
not our product which is being utilized. 

Further, we also expect that materials provided by the Lab be cr^ . .wsd 
to the Lab and that three copies of the written report be provif ^d 
for our files and reference shelves. 

We believe the work you are doing is ioiportant and will assist you 
to the best of our ability within the limits of ethics and honesty. 

Sincerely, 




Coordinator 
Research and Evaluation 
Program 100 



JWB/lob 



APPENDIX F 

COMMENTS BY RESPONDENTS—TABA 

Cofnments related to "Recommendations Ba s ed Upon 'Cofmants' bv Respondents. " 
(Chapter 1 1 . Number 1 ) " *^ 

I need a course In TABX alone In order to really under- 
stand and utilize It. The courie I took covered too many 
educational Innovations to be really effective. 

We who have taken the course, need more Intensified work 
In this area. 

I found It very helpful In grouping and showing relation- 
ships between other subjects. It's extremely lirportant that those 
taking the class have an opportunity to practice those methods 
with a class of children. I found that It took almost a year 
before I felt comfortable using the methods as a part of my every- 
day teaching techniques. ' 

Now that I have had seme background and time to experiment 
with the questioning technique, I would like to take the class 
again from a teacher who knows how to use it with young children. 

The program was presented with too much theop, , and not 
enough actual practical application for use In the classroom- 
would like to have the course ag'^ln because I feel It had much 
to offer If presented more practically. 

I have found the TABA processes a very useful tool In 
my teaching. It helps me help the chl Idren to tnink ^r.i -nake 
their own decisions. I find I can apply It very easily. I do 
think you need to keep refreshed of the methods to be effective. 

I would like very much to have a refresher course In 
HI Ida Taba techniques at the same time of year that I am teaching. 
I think I could learn to use It much more effectively. 

I feel parts of the TABA process are valuable, but 
extremely time consuming— particularly I am referring to the 
guide Anglo-America published by Contra Costa County, California. 
I also feel a need of more training, or a "refresher" course to 
keep the questioning strategies or purposes fresh in my mind. 
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ConmBnts Related to "Reeoamendatlons Based iipnn ^C e mQnf^^ hy Rncpr^nHAn-t■c " 
(Chapter 1 1 , Number 21 

Although I do not do a complete TABA task, I do feel that 
I phrase questions much better than I did before. It is a 
valuable course. I sometimes think It would be of more value 
after a person has taught a year, then take TABA. 

The TABA training considerably changed my teaching style 
to an Inquiry and discussion form. I am also aware of questioning 
levels and make strategy moves when discussion shows a necessity. 

Most of these processes and ideas I had already been using. 
The course only helped to refine my questions and allow me to zero 
in on my objectives better. 

I have attempted to apply TABA questioning procedures In 
my reading methods classes to the extent of helping college 
students develoo the ability to question children at increasingly 
higher levels of thinking. 

The training was most useful to me in terns of sensitivity 
to the different kinds of questions. 

Since completing TABA I am much more conscious of 
questioning techniques used by teachers In the classroom. 

I use the section pertaining to questioning strategies and 
procedures frequently. I also use the material that relates to 
concept and generalization formation frequently. 

Some of the Student Teachers have had a Strategies Course 
which have helped them in student teaching. Different strategies 
have been discussed at length in Seminar. Effective Questioning 
has been most helpful used In Seminars along with TABA. 

I personally feel that those students who have been 
Involved in the Strategies Course plus Effective Questioning have 
become much better prospective teachers. 

Comments Related to "Recommendations Based Upon ^Conments' bv Respondents 
{Chapter 11. Number 3) ^ 

Lack of time for personal preparation has prevented me from 
using what I learned more than I have. Even my summers have been 
so full that I have been unable to plan and carry out what I would 
I Ike to do In class. 

I do net use the knowledge or processes exactly as they 
were taught to me al I the tima. I do however use a variation or 
variations of these tasks frequently. 
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I felt that "Development of Higher Level Thinking" was the 
best course t took while receiving my master's degree. 

It has helped me organize my social studies units as welt 
as sequential steps In teaching math. DIscur.sion In weekly reader 
and fllmstrip and moving pictures have been enhanced by the 
training I have received In the TABA program. 

I feel that I use TABA techniques more often than I 
realize. It becomes a part of classroom |Ife<*3tyle. 

I would recommend the training, but I would also recommend 
more teaching experience before taking the course. 

I am teaching In an "open-space" school and f ?nd myself 
using my TABA training more now than before. I would say that It 
lends Itself more to this type of teaching. 

I plan to set up an extension course called Higher Level 
Thinking Abilities for teachers in the summer quarters here at 
Cal State. 

I have a class of 28 high achieving second graders who 
seem to gain greatly from the TABA method. It Is even hard for 
me to believe that children this age can get so enthused as my 
class has In the study of whales**mammals and the comparison to 
fish etc. Their parents and the librarians are amazed at their 
Interest and enthusiasm. My only problem Is lack of enough time. 

This method draws out even the most shy child and keeps 
the highly aggressive ones subdued and willing to share knowledge. 

I 've had two classes of TABA and one of RUPS. I feel 
they are extremely worthwhile, and the application of the tech* 
nlques I learned have enabled me to view many of my students In 
a completely different light. Many who do not respond well on 
pencil and paper tasks do very well In these discussions. I have 
graded them on their performance (the ones who perform well), and 
this has given them a renewed or new sense of worth and 
achievement. 

Some of the people who participated In the program with 
me had very negative attitudes concerning the value of the program. 
It Is my belief that they had those attitudes BEFORE they began 
and that their negative attitudes were a limiting factor. I 
personally learned a great deal from the experience and truly 
feel that I am a better teacher because of the program. We must 
not Ignore the negative comments however. The attitude of the 
participant Is as important as the attitude of the administrator. 
To effectively put the program across you had better have trainers 
who can "sel I." 
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I am currently teaching accounting and computer program'* 
ming. The bulk of the material in these courses is highly techni- 
cal, but I have found myself using the approach In problem defini- 
tion and analys ^, I think I can sum up the results of my 
exposure to TABA In one sentence: My approach to teaching has 
shifted from the direct to the indirect. 

The oral approach emphasized does help to bring out some 
of the weaker students. This Is especially frui In reviewing or 
Introducing a new Idea using task I. Task II Is good In summar- 
izing a unit or comparing groups of peoples studied. 

I thoroughly enjoyed the course and I am sure that I 
would have made much more use of the new Ideas If I had not had 
so many years of experience and was not so "set'* In my own way of 
doing things. 

Although my work has been as an administrator since my 
training, It has been beneficial to me In helping teachers with 
classroom problems. It Is unfortunate that most teachers do not 
have the opportunity to receive this trainlrj until they begin 
graduate work. I really think the training should be required 
and used In the undergraduate program. We need to move away from 
the "cognitive memory" emphasis and allow children to develop 
their true thinking abilities. 

I believe the TABA training is invaluable. The idea of 
trusting the child (student) to find and recognize truth— without 
the teacher^s evaluation is to me the most worthwhile aspect of 
the method. My thinking centers on the autonomous learner. I 
believe TABA makes a strong contribution here. 

Mve found these conceots viork, but you need time io 
develop them. One year is not sufficient time. Each year these 
systems are used tbe more valuablf> thoy become. To be properly 
used a t>ro - three year period realiy helps. In the program we 
are now using, I did not feel success until the second v^ar. 
Lots of practice is the key. 

I found that using the TABA method provided the opportun- * 
Ity to determine how much or what the students knew about a given 
topic, followed by research of what they needed to know then 
compiling the total data in a summarizing form. I find that 
children remember much better the essential facts by this method. 
The children enjoyed this type of instruction, and I think 
learning should be fun. 

I feel In Kindergarten we use the TABA training very often 
In a simplified form. Our class members In the TABA workshop 
made the difference. There was a wide range of interests and a 
variety of Ideas vocalized. I was fortunate to have been with 
this group. 
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I used this technique mostly in the Social Studies area, 
e.g. opening question wou'd be: "What do you know about the 
Indians of the Pacific Nr thwest?" The students would respond 
and I would write down "exactly" what they said (commenting after 
it was written— "Is this the way you wanted me to write your 
comment?" After we listed many things (50-100) we would go to 
phase IL In the second phase the children would scan all the 
comments offered, (usually written on butcher paper and hung In 
the room for all to see). The opening question \.ould be: "Are 
there any comments that seem to go together or look like they 
could be In a group with other similar ones?" After we placed 
each Item Into a group we would choose a title for that group, 
e.g. Indian Games, Indian Food, Indian Shelter, Indian Weapons, 
etc. After everything was classed— we would begin investigating 
our statements, gathering resource materials and exploring the 
general classifications. Individual students would report on 
one area that was of special Interest to them (to the class). At 
the end of the investigation we would make a general statement 
about the Indians of the P.N.W,— someth Inq to the effect— 
"The Indians of the P.N.W. depended upon their environment for 
food, shelter, clothing, transportation, etc. This researching 
usually took several months. An projects, creative writing, 
reading,— In essence all other subject areas could be related 
here. This would lead the way for the study of the Pioneers- 
approached In a similar way. I found this technique to be truly 
a process of discovery for the students and they really enjoyed 



I have shared these processes and Ideas with several of 
my student teachers In social studies, and they have used them 
successful ly. 

The Interest and part Icipatfo.i was re<-^lly high. I think 
children learn more this way and really get Involved. 

! believe that these "learning process" techniques are 
the very essence of education and are given much too little 
emphasis In col lege— teach I ng education— courses. We need many 
more communication skills, questioning skills, learning process 
type courses In teacher education and in-service training 
programs! 

I think 'Welopment of Higher Level Thinking Abilities" 
Is one of the most usef -l courses I have ever taken. I took the 
course nearly three years ago, but stf I I am aware of how useful 
It Is In the classroom, and how much It helps me be a better 
teacher. It»s very hard to say how often I use TABA principles— 
at first I was well aware when I was trying to apply her principles 
now rm hardly aware at all. I think the whole concept has 
become a part of the kind of teacher I am. 
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For the first time in my teaching experience the students 
are solving their own problems through discussion and for the 
first time the teacher \z I Istening— what a change for me. I 
actually schedule times for listening. I no longer feel the need 
to lecture and exhort. 

We are using cooperative teaching techniques In our 
Language Arts Block— many problems yet to be solved, but I 
believe we are beginning to communicate as a faculty. At least 
Mm going to keep trying to sell the faculty that we have to 
solve problems together if we expect our students to learn to 
do this. TABA has changed my teaching methods more than any 
course I have ever taken. 
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APPENDIX G 



COMMENTS BY RESPONDENTS—RUPS 



Two hundred eleven RUPS respondents wrote comments In the space 
provided. Many others wrote comments for specific Questionnaire Items 
(see Appendix D). The comments are arranged In four categories which 
correspond to specific Items under "Recommendations Based Upon 'Comments* 
by Respondents." They were selected by the Investigator as being pertinent, 
typical or Interesting. 

Comments related to^Observations and Recommendations Based Upon 'Comments* 
by Respondents— RUPS/' (Chapter III, Number I) 

The Intensive experience was Interesting, but no follow-up 
occurred. Therefore a useful tool went into disuse permanently because 
too much training was given too quickly. 

This program could have been more successful If we would have 
had more time. 



Toc^ much material was presented for the time allowed. 

I would like now to be Involved In a follow-up program- 
reviewing some of the concepts. After using It Mm sure there are 
some things I had missed and a refresher would be most helpful. 

The purpose of the lessons were not clear. In many Instances 
the directions led one to think that the objective was to accomplish 
a specific task; afterwards It was revealed that the task was of 
secondary Importance— the object was to determine how well one worked 
In the group. 

I think that this was given to us too fast without sufficient 
time to use each Idea before proceeding to the other. 

I +^ink we should have had more time and a follow-up or 
more detailed course. 

The workshop I attended was too concentrated and too far 
removed from a classroom situation. It was too easy to forget what 
was learned! 

I have applied these In a motivation program and have found 
that I am better equipped to help teachers operate more effective 
groups. 

The RUPS program Is good. However, the Intensive workshop 
of two and one-half days Is not enough time for Instructional 
purposes. 
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My team skills were greatly fmproved. Also helps communication. 
I would like to participate In a similar activity at least once a 
year to keep skills sharp. 

I felt the workshop was valuable and would recommend It 
for other teachers. I would like to attend the wcrkshop again to 
refresh myself with the material. 

I feel the program has merit but It Is just a one shot 
situation. If we Intend to affect change in behavior more activities 
are needed for growth by the Individual Involved over a longer period 
of time. 

Like any such technique It Is valuable If time permits to 
set It up, proceed through the program, and make a proper evaluation. 
I have had little time because of classroom duties In and out of the 
classroom. If the program could be simplified it would have more 
use for everyday classroom technique. 

Not enough training in the technique to really understand 

Its use. 

I think there should be more fo Mow-up and a secona workshop 
to help reinforce would be wonderful. A good program! 

I do not feel that a two or three day Intensive study without 
follow-up makes for a valid learning situation — especially when 
the area of study Is entirely new. 

I went through two sessions of RUPS and felt It had value 
— but needed the experience of practicing some skills which were 
not clear to me in the presentation. (I) Data gathering skills, 
(2) action planning. 

Ours was an intensive course of three days. Some follow-up 
or refresher would be well advised for that type I believe. 

There should be provision for follow-up sessions after 
the workshop or regular course: This would encourage people to 
use the techniques and tools^ also, provide more assistance for 
people who are really dedicated to self -Improvement. 

I would like to see a one-day follow-up workshop on RUPS 
about three years after one took the RUPS training sessions. This 
would help renew one*s background In the RUPS program. I have for- 
gotten most of the Ideas of the RUPS program at this point. 

The RUPS system has considerable merit and could be of even 
greatfjr value If the classroom teacher had a lengthened training 
period thus providing a more practical base for the application 
of techniques and principles Involved In the program. 
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Missing, and I feel vital. Is follow-up assistance by 
an old hand to snowball the use of the technique among novices 
who are easily re-rutted, i.e. return to old habits. HELP on 
this, please! 



Comments related to ^'Observations and Recommendations Based Upon ^Comments^ 
by Respondents— RUPS," (Chapter III, Number 2) 

As an administrator I have not used skills In a classroom 
but have on occasion used Force Field approach to problem solving 
and have used elements of group dynamics techniques. 

Force Field diagnosis is a remarkably useful tool. 

I have used the Force Field technique with building 
management teams as a part of efforts directed toward solving 
operational problems at building level- 
Good session—have used Force Field technique In problem 
solving alternative selection situations. 

The Force Field procedure Is useful In determining 
welghtedness of solutions to current problems. I have not 
otherwise used RUPS technique to this point. 

I haven^t followed the RUPS program as It Is written. 
Certain RUPS techniques and principles have affected my teaching 
indirectly. The Force Field diagnosis Is most usable and helpful. 

The RUPS training was most beneficial, however the 
personal style and personality of the trainer (RUPS instructor) 
is very Important. The Force Field diagnosis, diagrams and 
analysis has been very profitable for me. The use of Force 
Field analysis as decision making has great potential. 



Comments related to'*Observations and Recommendations Based Upon 'Comments^ 
by Respondents— RUPS," (Chapter III, Number 3) 

Small group dynamics within my classroom helped passive 
students take part In learning process. 

We have employed some of the RUPS training In our teams. 

I gained new insights and techniques relative to working 
vflth groups. 

I have organized my class to work In the triad. I have 
used the data gathering process of observation and group conference. 
As a result of RUPS I try to observe each child objectively with 
the goal of understanding him In a more rational way. 



I think RUPS training Is particularly good for people 
who wi 1 1 be doing team work. Group work becomes mor(=% productive. 

These comments were selected by t he Investigator as being of general 
Interest . ^ ^ ^ 

Much of the RUPS is used In my methods classes, both used as a 
technique in my teaching but also teaching the technique for the 
teacher-candidate to use in the future. 

An excellent follow-up of the RUPS program was Communication 
Techniques offered by C.W.S.C. 

Being an aide, I have not used the training in classrooms, 
except the paraphrasing skills which I find most useful with under- 
ach levers and slow learners. 

I used the RUPS approach in analyzing and working out school - 
wide problems with the teachers in our K-8 school. 

I feel the Interpersonal Communications program should be 
a prerequisite for RUFS. The divisions in groups— those who had 
IPC and those without was quite drastic. RUPS assumes that those 
taking training either have or can easi ly gain those needed skills. 
—NOT SO! Also feel TABA is good lead into RUPS. 

Occasionally with ^^y team of Evaluation Specialists, we 
have used some of the RUPS techniques with variations. This serves 
to get at the root of problem and helps to design methods of evalu- 
ating schools or support sendees. The system Is especially designed 
for teachers and can be helpful when sufficient confidence is devel- 
oped In the use of the system. 

The techniques learned in the RUPS training program have 
been used in relation to supervising the Montana vocational 
education program for the disadvantaged and handicapped. 

The principles and techniques of RUPS have been used mostly 
by me In faculty evaluation, helping team teaching communications 
and helping beginning teachers learn to listen and communicate^ 
with their students, 

I have used RUPS tools In other teacher^s (student and 
regular) to help solve problems. I also use RUPS tools in my seminar 
tor student teachers as a feedback about how the sessions are going. 

I have shown and used RUPS techniques with the 8th grade 
and am presently using It with a Junior-Senior class In Civics 
wherein we are using the technique for purposeful problem solving. 
Each experience makes It more worthwhile for having taken the 
training. 
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I was very surprised how the kindergarten level people 
just became so enthusiastic when ever we had a RUPS activity. 
They asked when wa would do It again. 

I have team taught the RUPS course three times and have 
used adaptations of the cours? In some of my college classes. 
The techniques are valuable only If they are utilized soon after 
the course. 

I found It very helpful to have received an additional 
copy of each of the work sheets used during the workshop — this 
made It easier In utilizing the approach later. 

Of special benefit from the RUPS training was diagnosing 
classroom behavior more objectively, analyzing aggressive behavior 
and learning how to channel Into more useful or positive activities. 
Problem solving Is being done alt the time. RUPS helped with 
techniques and procedures. 
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